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(54) METHOD AND APPARATUS FOR MEASURING THREE-DIMENSIONAL PROFILE 

(57)Abstract: 

PURPOSE: To provide method and apparatus for 
measuring a three-dimensional profile highly accurately 
even in a region where the distance varies abruptly and 
even when only a single lens image sensor is employed. 
CONSTITUTION: The three-dimensional profile 
measuring apparatus comprises a section 102 detecting 
the optical flow for a plurality of images being fed to an 
image input section 101, a section 104 for extracting the 
edge region from the image, and a section 103 for 
operating the distance information based on the principle 
of triangulation through the use of the optical flow. The 
measuring apparatus further comprises a section 105 for 
operating the distance information directly from the self- 
motion information received from the image input 
section 101 according to the relation between the time 
difference and the spatial gradient of image. The 
distance information around the edge region is operated 
at the direct operating section 105. The distance 
information is integrated at a depth map synthesizing 
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section 106 and delivered from a depth map output section 107. 
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g&l 1 5<DtiiJli>7 ! 7'x-7 ■yT'Stft&il 1 7ICA^LT 
V*6 0 7 f 7'^-7 5'7'-&B)tS?l 1 714, |&l*>J:t/£20 

im%m&i 1 4, 1 1 snmiiK&c, hasis so 
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ssasi i e-c^fc^Kfcr^taKftssai 1 3 

X*lbbtl1tT7'Z k y y k LX$&tZ> t 

flgBl 1 8HfLTflffilctti;fr$ix5 < fc5lCfco-CV 

[0046] BfcATjf&i io, mmmm 13*; 
wEmmm 1 1 eat. jbi£&m 

(@ i ) <DB«!A^gi5 loo. mmmn losax 
vEm&m® i o 3 k m i^a^mc 5 «t 9 

$iitV5. K/<X7^;^SB1 1 Hi, jS»f f - 

2i±, vy?vfmzx^xn&&m*:ftt£o wx 

.(x. y). g,(x, yWftfcWaLfcflWMr^PV** 

[004 7] 
[»1 0] 

e(f,«j)-E B l*o( l -f.y-i>-g|(x.y)l ••• (io) 
•(f.«j)-S B l8o(x-f.y-«j)-BiUy)l 2 - (ii) 

(D«fc5K, ii«iw||»w|ft*fffl[» [*(io)] , *>5i*t 
X, C«)IHiBMkfl3«^ft^t'5ei«fl[*({. n)«r* 

7^%«LT^t5. 1 Kttftft&fll 1 1 4. 1 1 5 
tt, ^tl^nA^ffi#lc*tLTl^«S^*&g^te1-tW 

^ 1 <7> 1 &»t#fcg6is 1 1 4 \z\mm%xx 

ft IX^Z <DXZ<r>tHt)tt.mWt%<r> 1 fem&k tt 

9, ii2<oii«iis^iaagiJi 1 5iumm%<» itm 

[0 0 4 8] x^^-ryy^BlSl 1 7ICLOP 

1 1 7ii, =mimn&i 1 6tattfe»»tti 1 3 

if*>b<0r^Sr«ife$-tir5*W4, l®»^jS8SPll 
4, 1 1 5©m^filSr#»^') t LT^*P)ti5„ 

[004 9] @5W*i^l4ii«<0»S^fli<0-{»|^inU 
TfcO, /<> hv^7^/u^Si51 1 0OflB#lCj:»), » 

UBxwittmmt 2 mk^nw/h $ v we*> 0 . * 
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v-y^figaJl 1 614. £ 1 ®8#«*85 1 1 4, 1 1 

smmzmtx, i%n%&<r»\^mx-\±^ 

v-^ii ^7?^WH i 7 iijwyj$ix5„ io 
10 0 5 0J «!&33iJ6eiJ» fctc. *«MrolB3|ltefiS! 
w3&%j&tt9J££8lcov>T, iroHiBeil 

a*a>b#rf*ro«ff«8£fcttiL. ttJMHttlcHLTIi 

-5 < o T ^ 5 f 7x iIS5feT**«>fcr 7** 

$r^JfLTV^< tcDT-fci, 0614, *£Ikfl«> 3 

[005 1] m&Xfi® 1 2 0 0>dJ7jl4, *7r -f *A- 20 
7o-^ajSCl 2 I i:Btfeffi«ttffi&61 2 SlCAftL. 
*^-f*/U7D-Htfj»i 2 1 otitfttlcilHfiMk 

fflSSl 2 lOlBAll, ffi«ffi«}ftiijeiJ 1 2 3lrtA73L 

■cua. is««Hi«ttaism2 3(oaj^fflici4iess}S» 

«i24!MttrtMvc*s9, S&lc. HAflftMUm 
2 2 fcfttt&MItt 1 2 4 Wl*'*l#fcfcftfcf ? 7'* 

5. f^^y^dtan 2 5T*3fci!>e>ilfc7 f 7';ivj, 
7'l4x7'^^5'7*tij^SPl 2 6*>6W*SnSJ:5lc4 30 
oT^ft. BtRA^fflSl 2 0, *77^;fr/U7n-ifctH 
SHI 2 1. EftiSISiSSSBl 2 2. iE&ifcSI»g|5l 24 
43iOfryxv- 7 7 , ffi73S)5l 2 614. Ml* 
tlffi (E) 1 ) WBflfeA/jSH 10 1. *7°-r -< */U7p- 
mU 10 2, HftflftfltBtt 103. BS&flkgtt 1 
0 5fcJ;tJ t ry^-7y7'ai^l 0 7fcBI*(Dt«)-e*» 

loo5 2j m^m^ta,% 1 2 3 14, *tt * #/u7 
oh*w»i 2 1 wffl/rts**«nT, y 

•^gi!-f^t>*)7 ! 7*^^5.-9i»lc^<ff5gi«E&ttffl-t5„ 40 
AfmiCli. *77w;&/W7n-£r(u. v)i:LT 
[00 5 3] 

«trttffl-f*. w*ilc^Lr7°^^y7 , -g-fiea51 2 5 
14, *;^4**7P-i=*H*l£»^<*8n»** 
ofc7 f 7*^vy7*lC*tU tt*»t»**ofc? f ? , xtrrt 
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tvltlttit, MSBWfrottfcfcUTWH&wlt 
T7x-7y7'l4r7'*vy7'ffl7jgBl 2 6i9ffl*$n 
10 0 5 4] CS4 9Hfifll ftfw. *«W«)$4fltt0!l 

vmmmt* ®&Ktim&V)azm+ smut 

W»*r«tTV»4. B7l4*H«W03ft5c^RtHfi« 

10 0 5 5] 8ft-ffl*£Bfex-* t LTE 9 i&trBtt 
A7JSIS2 OOfctt, »ftiB»5:«»1-'5fc*rouvX2 
Olt, CCDt£Z<DWtX*2 0 2t. MS? 2 0 
2*»fcroW*flr«-*tW*+5*>7'/u/**-yi' K0K2 
03t, lhV7^/*-/uKlH)!&2 0 3*>?>ffl7j*ii5 

-/I/) S»(fft9AGCEWS2 0 4t. AGCIa]K2 0 4 
*>tB*ttfcW*e>*lfcA/D <71-b*-799A>) $ 

«S2 o 5 kktvxmi&ziix^z. mm*2 o 2 

A/D££«2 0 5 ©JB^tt, ItaWfcM*-* fc L 
T. tt&f*M^fl2 3 0Kft|»&iVOV&. * 
fc, HftA/jfiH 2 0 0 ICf4. E«A7)S? 2 0 0 ?>#ffi>fi 

x.tffif)^-ri'o^3-7 , Oi9'iftiiS-fe>t2 2 1 

t, fim*>-*2 2 l-ewu^iifcftXKii^&m 
A*s?2 0 oo»i)S^»ta-r5^«)ftiiaiiHiK2 2 2 

fctfRltbtiTV'*. »i*S»aj(aJ»2 2 2Wffl7jl4. 
B»fcg852 3 OKfflftSiVO'8. 

loose] ®mm 2 3 0 14, Btte^eat j: o 

# tr-*lWMW»t*»»> * 'J 2 3 1 1 , SffiwB« 
r-^iBtfe^^e !J 2 3 1 lcfla**Jifc-£«IHIWW>a 

•CroSB8^«»-t-6 ffiHSi»lHlK 233tlIJ:oT 

flwsnx^s. mmn^2 3314, zftiffifirom 

ffl@l52 2 2A>6tM7£4i&fFftftttfrSIIJt£ tT, 
*S2 2 3-C t tt»$h-/lEKT-^l4. til7)ig^2 4 0«r 

[0 0 5 7] ftlc, ro3*j^M£flftalMMrtt 
i/>*2 0ltt««fcft«r«k»T-2 0 2lclS 
ttU i8«!*^2 0 2(4ttff9Jff:o«Sr)tmaf*LTB 
ft«*4 tfffi^jL, r©W^tt*v^/*-^ KB 
?S2 0 3ICRfif$ix5. AGCE?82 0 4l4g»)WlCB 



(9) 

IS 

■Sffrffim^tl-tZ, -t, @J&A;/}gI52 0 0IC*tL 
T®£SftT^S#l!)S$&aig&2 2 Om SiiS-fc^ 
t2 2UCJ:oT. BlitfiA^Si52 0 0(Dlb# (mm 

m-mztixif). m&mm2 2 2-ph, a 

10 0 5 8] BI6iaSSB2 3 0lCfc^T, 

* y 2 3 1 l»!te-*»«fl»tt**l, - JtlU o T 

2 3 2li. A/Dt«^2 0 5A>P,ttgA^1-5SS© 
Bfct, B§fe^*!>2 3lAlC!Etg$JxTV>5-£B*l« 

LTtt. ft l HifeWei*^ Jt 5 lc, ft£ 

*nt*«*Wf4*»n*fc. to&«ttBiiftftBft2 

3 3irA^t5 0 EMftftBft2 3 3m »»S*W 
@K2 2 2T-Sffl£ftfcB<8A*&2 0 0©£»**rS 

*r&it3*s3B«**s4n*. 4fc. bb«Ks»<- 

i 5 fcW#roBtt«rlia£ktf fc»£« 2 o©B 

<wi-e»»j6*©»»ttt. m&mm 2 3 2 k j: 

© 3 ftxJMttmK* WlcM&*&# <bi8&©B 
«SrA^**5^<blc«t*), fc£%lc*©»tt«*©4 

[0 0 5 9J 08 li. *ftttft©3&7cJ*#ftttKB* 
ffl^"C3BRK»>aai*<oafWMI«r»9 iiA/"CV^ fc £ 30 

MB*2 7 0tt. *0I16W©3 
0C3ci0«fNMttC 2 S 0 (C« 9 Wit fcfifc ^ y •> /2 6 
Ofcori^ B5«r#tfL-CM^«t 1 'DICL-twW3*7c}g 
ttftM£B2 5 0*:ttfft-ftft: (7fl#) fcJ»LT¥f?fc 
*JEU -©»H***»BL-CP5. ^'Js'7'2 6 0 

fc#>©{>©T-*>S„ 

[0 0 6 0] gtfflf 2 7 0*3K7E£ttttB£ft2 5 0 
Cl^j&*«SBft©tt»i. Ml/«y 2 3 1 ©SI 
"Cft* 3. BttA*»2 0 0ifO*k*S«**f-A. 40 
^T*;M7*ttflJ-*-5ft£lCli. Bttt*9&tr*-f 
gv/fcfflM^ 7 0)it#*>3-effi6ic:i8A/-efc&<-' 
U I«4fi1:>1f2 2 i©fflflfc*ilfflLTB©tB9©M 

t5:HtS5. 4fc. *fl}U:S»£Litf9i&tfB 
•OtNtflffiLTiS*. HHLrirfcN*. IKttHfr 
©Bft*A*jl/Ct>J:L'. fc*»*A/. ®«A^SB2 0 0 
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*«nat5fcJ!>©Bflk©a«ri*K»^5«)-e, ##© 

(ftft#) 2 7 oa*tttHB*fc»LT 3fc7ci*ttttSIK 
112 5 0 Sr^tts^ripjuftt^ Abixfct>©-e«* 

<, @ttic£i;TrcD#fitft£ttitf<fcv\ 
[0061J tr^-e. *ftft«-eii. 3 tf^jtf&m m 
mtfftmtomztMzBaozzzmb Lamm 
m-rz<Dx\ mmxa*< wrMmittSK. 

tm^xtoiEmnv&zm-t-z. 

[0 0 6 2] B 8 tt, ««#tJ:oT3fta«WW!B 
l2 5 0«:*sp*l6jlC*JEL//A5?>«KUfct#(O, * 
©3*««WW«12 5 0©B«W»«rJ:*»bJI,fcB 

WfBftl2 5 0©RBa»©*'fc-C*>$. a 
©S5(0fi$. 8 (5 5?7>*tt) UBBBBA. stt# 
iftftfcUJ® 2 2 0 -C** ?>*vfc 3 fcxf&KitSHSli 2 5 
oo^tbfi. Ltt¥miBi»©B»ft-e*>a. «!£&© 
B«>ft*a*#itu4ji.e>*iTv»ntf, s«fiLiiT^ 
•e**6. 

1006 3] 
t&l 2] 

L-2a^siii(|-) - (13) 

n-e, 

[0 064] 
l&l 3] 

9- -2- -(14) 
a 

XhZ> Q LfctfoT. Z.<DZ.HlLX*.lt)bhk&lft5: 
Lfc*o-cffl*£©li|jEfcfTfc*.li.fcv\, ®<ft© 
ttlEli, BBB*©a«fciTXT»41-afc»S*©«W 

4 1 SBtt»«:*T©B«©BKe UT*t+5«*« 

[0 0 6 5] «ft 5 ftftffl) » 4 iafi«-ei4, Btt* Sr 

A^SB©»»ftS:iIS«lttlLfc. L*>U. «BWKi3V^ 
■CBBA*»©»B»«)W-B*tttt, ZMzmbKZh 

<ox-\±t£ < , fsi e> A»©*a-ettsi#©«)# ^rtvan lt . 

[0 0 6 6] ttH#©»4**Brt-6*ifcfcLT. ®« 
5*tt/iif*5^9. iOiESWlcH-SJ^wlli^Sr^illf 
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6. KIT. itmnmzmi-ZZKbtolimc^ 

xm-tz. 

zs.tz>zti>*imx'hz>. 

I0 0 6 8J aW***!*, S^fiOfcfiiiJ: 

^agso^rA^^os^jtwes^BJj-caiEi-stw io 

10 0 6 9] K7 7 4 ft. )fc7r-r^SriiiS1- 

7 7 'T /<£8tilJ#C0ft|C® «9 f + rt 5 J»». *>5l Mi3t7 7 
-f Lfctfr-f *-yfctWMfa>#lcotf, St 

9. tt»f©»*«rW»1-S. 20 
[00 7 0] EETJ-fe^-r&fflV^ifcm E^irvt 

WWc, z<Df£t)±y*ZttM%<r>to 

[00 7 1 ] H«f ©«*(fi[«r««t*S!ftt-CHi, ftfl 
#©tt*ilC«I*»9tW. m (Still) *tf>|g5<Ofi# 
K« CT«4+ft Wttt««fctr*W LT, ZfiX 9 S 
tfc8tro#»)S£#*>5o 30 

[00 7 2] 

[«9I<D$£] B±RWLfcJ:?IC**W«>3J»cjaett 

55SU0B1 n3&7C»ttft8Hftltli. t/f^^a 
9 S6fc*»W«>a20>3ftxJIHttll£ 



[0 1 ] f& 1 fSJ&fl© 3 ft5^ttStffl!lSSrolfWt**-f 
[0 2 1 (a) ~ (c) li-tn-e *ii y ^ttHJOSaSrRWt 
(03] 3»5c2K-W)»*f»ao*3Itt^^-*«rltt 
[B4] *2*«««)39:7c/g«StSI8IE<o«rit«r*t 

*>*„ 

[0 6 ] IS 3 %m<0 3 R7C«*tftjB!l«IK<Ol»dt*^t 
7*n-y*0-C*>£„ 

[07] %4mm<D 3 &7G^tt?tffl&fi<0«fi££^-f 
7* Dy?@ 

[08] »4*«WlCj3lt53ft7C^iil^*fr*ife 
«rSftMt50t?fc5. 

[09] ffijEJaaSr»W-T60-e*»5. 

[010] EftM£*K9H-S 
0T**>5, 

10 1.1 1 0,1 20,200 BfcTJitB 

10 2,121 ^7'7-^*/W7D-^aia 
1 0 3,1 1 6,1 2 2 H^lWSSSiS! 
10 4,1 23 0&&$tttti& 
1 0 5,1 1 3,1 24 fiSS^SSi! 
1 0 6,1 1 7,1 25 r7**-T5'7'ih*8P 
1 0 7,1 1 8.1 26 r7'^^y7'ttJ^8P 
111 /<> K'<*7-f/i'*8B 

1 1 2 7?fX^ltSJ|i» 
114,115 l«?»#lft!lffi 
20 1 UV* 

202 CCD 

2 0 3 *>7>/*-/U K0M 
204 AGCEK 

2 0 5 

2 2 0 ^SSbS^tB&B 

221 fim&ty* 

2 2 2 «gbfl9tU0K 

230 m&&m% 

23 1 Stfty*!) 
2 3 2 #££8*191* 

233 mmm 

2 4 0 tUTJiS^ 
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[02] 



101 



MAAft 



7PH 



103 

i 



4** 



4 



mm 



106 



6$M 



0 



ioH_J^»_ 
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a. 



4r 



— sr 



[133] 

Y 

CJW, 
tT, 




-Or 



Z=-T B -W B -Y*W T .X 



1134] 



no 

WW ■ 



111 



HAM 



112 



1U 



*1W 



115 



M18 



GAS 



117 



[05] 



[06] 




120 



121 
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7*HMS« 
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